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Abstract 

The notion of quasi-Fejer monotonicity has proven to be an efficient tool to simplify and 
unify the convergence analysis of various algorithms arising in applied nonlinear analysis. In 
this paper, we extend this notion in the context of variable metric algorithms, whereby the 
underlying norm is allowed to vary at each iteration. Applications to convex optimization 
and inverse problems are demonstrated. 
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1 Introduction 

Let C be a nonempty closed subset of the Euclidean space R N and let y be a point in its 
complement. In 1922, Fejer [21] considered the problem of finding a point x G ~R N such that 
(\/z £ C) \\x — z\\ < \\y — z\\. Based on this work, the term Fejer-monotonicity was coined in [27] 
in connection with sequences (x n ) ng N in ~fil N that satisfy 

(VzeC)(VneN) \\x n+1 - z\\ ^ \\x n - z\\. (1.1) 

This concept was later broadened to that of quasi-Fejer monotonicity in [20] by relaxing (jl.ip to 

(Vz G C)(Vn G N) \\x n+1 - zf ^ \\x n - zf + e n , (1.2) 

where (e n ) n eN is a summable sequence in [0, +oo[. These notions have proven to be remarkably 
useful in simplifying and unifying the convergence analysis of a large collection of algorithms 
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arising in hilbertian nonlinear analysis, see for instance [21 [121 031 EH 032 SOI EH 135] 
and the references therein. In recent years, there have been attempts to generalize standard 
algorithms such as those discussed in the above references by allowing the underlying metric to 
vary over the course of the iterations, e.g., [3 UM [HI HI [261 [29]. m order to better understand 
the convergence properties of such algorithms and lay the ground for further developments, we 
extend in the present paper the notion of quasi-Fejer monotonicity to the context of variable 
metric iterations in general Hilbert spaces and investigate its properties. 

Our notation and preliminary results are presented in Section [2j The notion of variable metric 
quasi-Fejer monotonicity is introduced in Section [31 where weak and strong convergence results 
are also established. In Section [H we focus on the special case when, as in (|1.2|) . monotonicity is 
with respect to the squared norms. Finally, we illustrate the potential of these tools in the analysis 
of variable metric convex feasibility algorithms in Section and in the design of algorithms for 
solving inverse problems in Section [6j 



2 Notation and technical facts 

Throughout, % is a real Hilbert space, (• | •) is its scalar product and || • || the associated norm. 
The symbols — v and — > denote respectively weak and strong convergence, Id denotes the identity 
operator, and B(z; p) denotes the closed ball of center z £ Ti and radius p G ]0, +oo[ ; S (H) is 
the space of self-adjoint bounded linear operators from % to T~L. The Loewner partial ordering 
on S (H) is defined by 

(VLi G S (W))(VL 2 G S {%)) L X ^L 2 ^ (Vx G U) (L lX | x) ^ (L 2 x | x). (2.1) 
Now let a G [0, +oo[, set 

7 a {%) = {L G S{H) | L >p aid}, (2.2) 

and fix W G J'a('H). We define a semi-scalar product and a semi-norm (a scalar product and a 
norm if a > 0) by 

(Vx G H)(Vy G TI) (x | y) w = {Wx | y) and ||x|| w = y/(Wx | x). (2.3) 

Let C be a nonempty subset of H, let a G ]0, +oo[, and let W G !P Q (%). The interior of C is 
int C, the distance function of C is dc, and the convex envelope of C is convC, with closure 
conv C. If C is closed and convex, the projection operator onto C relative to the metric induced 
by W in flZSJ) is 

Pq • T~L y C '. x i y argmin ||x — y\\w- (2-4) 

We write = Pc- Finally, ^+(N) denotes the set of summable sequences in [0, +oo[. 

Lemma 2.1 Let a G ]0, +oo[, let p G ]0, +oo[, and let A and B be operators in S {%) such that 
/ild ^ A ^= B )p= aid. Then the following hold. 

(i) a' 1 Id ^ B- 1 ^ A' 1 ^ p,- 1 Id. 

(ii) (Vx G H) {A- l x | x) ^ pH-^lxll 2 . 
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(iii) WA^W < a' 1 . 

Proof. These facts are known [2A\ Section VI. 2. 6]. We provide a simple convex-analytic proof. 



Jijj It suffices to show that B' 1 fc= A' 1 . Set (Vx G /(z) = (Ac | x)/2 and #(x) = (Bar | 
x)/2. The conjugate of / is /* : rt — > [—00, +00] : u h-» sup^g-^ ((x | u) — /(x)) = (vl -1 !* | u)/2 
Proposition 17.28]. Likewise, g* : rl — > [—00, +00] : u 1— > (B~ 1 u \ u}/2. Since, / ^ g, we have 
g* ^ /*, hence the result. 



fig} Since P||Id ^ A, RH] yields A" 1 ^ ||i4|| _1 Id. 



(iii) We have ^4 1 G S (%) and, by (i) (Vx G ||x|| 2 /a ^ (A l x \ x). Hence, upon taking 



the supremum over B(0; 1), we obtain 1/a ^ \\A 1 ||. □ 

Lemma 2.2 [301 Lemma 2.2.2] Let (a n ) ng N &e a sequence in [0, +00 [, Zei (r? n )neN G £j_(N), and 
let (e n )nGN G ^+(N) be such that (Vn G N) a n +i ^ (1 + r] n )a n + e n . T/ien (a n ) ng N converges. 

The following lemma extends the classical property that a uniformly bounded monotone 
sequence of operators in S (H) converges pointwise [331 Theoreme 104.1]. 

Lemma 2.3 Let a G ]0,+oo[, let (f? n )neN G £+(N), and /ei (Wn) ne N a sequence in TaCH) 
such that u = sup„ eN ||W n || < +00. Suppose that one of the following holds. 

(i) (Vn G N) (l + Vn )W n ^W n+1 . 

(ii) (Vn G N) (l + Vn )W n+1 ^W n . 

Then there exists W G lP a (7^) such that W n —> W pointwise. 



Proof. [fij] Set t = IInGN( 1 + Vn), t = 1, and, for every n G N \ {0}, r n = fl^oC 1 + Vk)- Then 



r n — > t < +00 [251 Theorem 3.7.3] and 

(Vn G N) nld )>= W n ^ aid and r n+ i = T n (l + ry n ). (2.5) 

Now define 

(Vn G N)(Vm G N) W n , m = — W n — W n+m . (2.6) 

Tn T n -\-m 

Then we derive from (|2.5p that 

n+m— l 

Tn T n +m 

k=n 

< — (W n x I x) — (W n+m x I x) 

Tn Tfi+m 

= (W n>m x I x) 

< — (W n x I x) 

Tn 

< (W n x I x) 

< n||x|| 2 . (2.7) 



(Vn G N)(Vm G N\ {0})(Vx G U) = —{W n x \ x) TT (1 + n fc )(W n x | x) 
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Therefore 

(Vn G N)(Vm G N) Wn,m £ ^o{T~L) and ||W n ,m|| < M- (2. 

Let us fix x G By assumption, (Vn G N) ||aj[|vp n x ^ (1 + ^tOIMIkv Hence, by Lemma [2? 
(ll x llw„)™eN converges. In turn, (r" 1 [|sc||pp )neN converges, which implies that 

IMIw™,™ = ( w n, m x | x) = — \\x\\w n — ||z||w„ +m as n, m ->• +oo. (2.9) 

Therefore, using (|2.8p . Cauchy-Schwarz for the semi-norms (|| • ||w nim )(n,m)eN 2 > an d (j2.9f) . we 
obtain 

||W„ im a;|| 4 = (x | W nim x)^/ njm 

^ IMIw„ jm l|Wn,m^||w- njm 
^ IMIWn,™ V 3 \\ x \\ 2 

-> as n,m-^+oo. (2.10) 

Thus, we derive from fj2.6f) that (r~ 1 W n x) ng N is a Cauchy sequence. Hence, it converges strongly, 
and so does (W n x) n <=^. If we call Wx the limit of (W n x) n £N, the above construction yields the 
desired operator W G < J' a ('H). 



(ii) Set (Vn G N) L n = W n l . It follows from Lemma I2.1|[i)^ (hi) that (L n ) ng N lies in 



JlAuC^), sup ngN ^ V Q > and (Vn G N) (1 + r] n )L n ^= L n+ i. Hence, appealing to (i) there 
exists L G ^xui^H) such that ||L|| ^ 1/a and L n — > L pointwise. Now let x G H, and set 
W = L' 1 and (Vn G N) x n = L n (Wx). Then W G ?«(%) and x„ -)■ L(Wx) = x. Moreover, 
\\W n x — Wx\\ = \\W n {x — x n )\\ ^ fi\\x n — x\\ — > 0. □ 



3 Variable metric quasi-Fejer monotone sequences 



Our paper hinges on the following extension of (|1 .2j) . 

Definition 3.1 Let a G ]0,+oo[, let (p: [0,+oo[ -> [0,+oo[, Zei (W n ) ng N ^ e a sequence in 
y a {T-L), let C be a nonempty subset ofH, and let (x n ) nG N be a sequence in %. Then (x n ) n ^ is: 

(i) (ft -quasi-Fejer monotone with respect to the target set C relative to (Wn)neN if 

(3 (7? n ) neN G ^(N)) (V* G C) (3 (e n ) neN G ^(N)) (Vn G N) 

4>{\\x n+ i - z\\ Wn+1 ) < (1 + %)0([|»n - 2 l|w„) +£n; (3.1) 

(ii) stationarily (p-quasi-Fejer monotone with respect to the target set C relative to (Wn)neN */ 

(3 (e n ) neN G ^(N)) (3 ( Vn ) nm G ^.(N))(Vz G C)(Vn G N) 

<KH«n+l - z||Wn+i) < (1 + ??n)0(||x„ - z||w«) + £ n- (3.2) 

We start with basic properties. 
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Proposition 3.2 Let a G ]0,+oo[, let <p: [0, +oo[ —> [0, +oo[ be strictly increasing and such 
that limj_ i>+00 <p(t) = +oo, let (Wn)ngN be in y a {%), let C be a nonempty subset ofrl, and let 
(x n ) ng N be a sequence in rl such that ()3. 1 j) is satisfied. Then the following hold. 

(i) Let z £ C. Then (\\x n — z\\w n )neN converges. 

(ii) (x n ) ng N is bounded. 



Proof, (i) Set (Vn G N) £ 

n — \\%n z\\w n ' ^ follows from f)3. 1 1) and Lemma \2^2\ that (<^(£n))n£N 
converges, say </>(£ n ) A. In turn, since limt^. +00 0(i) = +oo, (£ n )ngN is bounded and, to show 
that it converges, it suffices to show that it cannot have two distinct cluster points. Suppose to 
the contrary that we can extract two subsequences (£fc„)neN and (£/ n )neN such that — > n and 
£l n ->■ C > "> an d fix e G ]0, (C - n)/2[. Then, for n sufficiently large, £k n ^n+e<C~£^ 6„ 
and, since (/> is strictly increasing, ^ </>(?7 + e) < <?KC ~~ £ ) ^ 4>(£,i„)- Taking the limit as 

n — > +oo yields A ^ 4>{rj + e) < 0(C — e) ^ A, which is impossible. 



(ii) Let z G C. Since (W / n )neN lies in y a {%), we have 

(Vn 6 N) a\\x n - z\\ 2 ^ {x n - z \ W n {x n - z)) = \\x n - . (3.3) 



Hence, since (i) asserts that {\\x n — z||w„)neN is bounded, so is (x n ) n ^. □ 



The next result concerns weak convergence. In the case of standard Fejer monotonicity (jl.ip . 
it appears in [3 Lemma 6] and, in the case of quasi-Fejer monotonicity (|1 .2[) . it appears in [IJ 
Proposition 1.3]. 



Theorem 3.3 Let a G ]0, +oo[, let <p: [0,+oo[ —> [0, +oo[ be strictly increasing and such that 
lim f ^ +00 4>{t) = +oo, let (W n ) raS N and W be operators in CP a (W) such that W n — > W pointwise, 
let C be a nonempty subset of%, and let (x n ) nS N be a sequence in % such that (|3.1|) is satisfied. 
Then (x n ) n ^ converges weakly to a point in C if and only if every weak sequential cluster point 
of (in)nefj is inC. 



Proof. Necessity is clear. To show sufficiency, suppose that every weak sequential cluster point 
of (x n ) n£ N is in C, and let x and y be two such points, say Xk n — 51 x and xi n — y. Then it 
follows from Proposition I3.2^T)| that (||2; n — x||vi/ n )neN and (||x n — y||w„)neN converge. Moreover, 
IMIw/ n = {W n x I x) — > (Wx | x) and, likewise, ||?/||^ n — > {Wy \ y). Therefore, since 

(Vn G N) (W n x n \ x-y) = -(\\x n - y\\^ n ~ \\x n - x\\^ n + \\A\w n ~ IMIwJ' ( 3 - 4 ) 

the sequence ((W n x n \ x — 2/)) n eN converges, say (W n x n \ x — y) — > A G R, which implies that 

(x n | W n (x - y)) -> A G R. (3.5) 

However, since x^ n — 1 x and Wk n (x— y) — > W{x—y), it follows from (|3.5p and Lemma 2.41(iii)] 
that (x | VF(x — y)) = A. Likewise, passing to the limit along the subsequence (xi n ) n ^ in (|3.5p 
yields (y \ W(x — y)) = A. Thus, 

= (x\ W(x - y)) - (y | W(x - y)) = (x - y | W(x - y)} ^ a\\x - yf. (3.6) 



5 



This shows that x = y. Upon invoking Proposition I3.2;(n)| and Lemma 2.38], we conclude that 
x ^ x ■ 

Lemma 12.31 provides instances in which the conditions imposed on (W n ) n gN in Theorem 13.31 
are satisfied. Next, we present a characterization of strong convergence which can be found in 
[12\ Theorem 3.11] in the special case of quasi- Fejer monotonicity ()1.2j) . 

Proposition 3.4 Let a G ]0,+oo[, let x G [lj+oo[, and let <fi: [0, +oo[ — >• [0, +oo[ be an in- 
creasing upper semicontinuous function vanishing only at and such that 

(V(6,6)e [o,+oo[ 2 ) <K6 + 6Kx(<K£i) + <K6))- (3-7) 

Let (Wn)neN be a sequence in ? a ^H) such that \i = sup nGN ||W n || < +00, let C be a nonempty 
closed subset ofH, and let (x n ) n< =^ be a sequence in % such that (j3.2|) is satisfied. Then (x n )neN 
converges strongly to a point in C if and only if lim dc(x n ) = 0. 

Proof. Necessity is clear. For sufficiency, suppose that lim dn(x n ) = and set (Vn G N) £ n = 
inf^ G c \\x n — z\\w n . For every n G N, let (z n! k)k&n De a sequence in C such that \\x n — z n) k\\w n £n- 
Then, since <p is increasing, ()3.2[) yields 

(Vn G N)(V/c G N) 0(£ n +l) < <K||x n+ i - Z n ,ft||w„ + i) < (1 + %)^(||«n - Zn,ft||wJ + £n- (3.8) 
Hence, it follows from the upper semicontinuity of <fi that 

(Vn G N) <K£ n +l) < (1 + %) lim <Klkn ~ 2n,jfc||wJ + 

fc— >+oo 

^ (1 + Vn)^n) + £n- (3-9) 

Therefore, by Lemma 12.21 

(<M£n)) ngN converges. (3.10) 

Moreover, since 

(Vn G N)(Vm G N)(Vr G %) a\\x n - xf < ||x n - x\$ JVm ^ //||x n - x|| 2 , (3.11) 

we have 

(Vn G N) V^d c (x n ) ^d c (x n ). (3.12) 

Consequently, since lim dc{x n ) = 0, we derive from (|3. 12|) that lim £ n = 0. Let us extract 
a subsequence (6c n )neN such that - > 0. Since is upper semicontinuous, we have ^ 
lim</>(^fc n ) sj lim (f>(^k n ) ^ (f)(0) = 0. In view of (|3.10p . we therefore obtain (f>(£ n ) ~ > and, in 
turn, £ ra — > 0. Hence, we deduce from (|3.12p that 

d c (x n ) 0. (3.13) 

Next, let ./V be the smallest integer such that N > y/Ji, and set p = x N1 + J2k=i X k if N > 1; 
p = 1 if iV = 1. Moreover, let x G C and let m and n be strictly positive integers. Using (|3,lip . 
the monotonicity of </>, and (j3.7|) . we obtain 

•Klkn - *l|vO ^ 0(v7^[|«n - ^||) < <f>[N\\x n - x\\) ^ p(/>(\\x n -x\\). (3.14) 
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Now set r = Il/teN^ + Vk)- Then r < +00 [25], Theorem 3.7.3] and we derive from (|3.7p . ()3.2|) . 
and (|531D that 

X~V(lkn+m - X n \\ Wn+m ) ^ X~ } {H\\Xn+m ~ x\\w n+m + \\x n ~ x\\w n+m ) 

< 0(||x„ +m - z||w ro+n ) + <t>{\\x n ~ x\\ Wm+n ) 

(n+m— 1 \ 
^(||xn -a;||w„) + X] £ k) + ^{\\x n - x\\ Wm+n ) 
k=n ' 

<p(l+r)0(||x n -x||) +r^e fc . (3.15) 

Therefore, upon taking the infimum over x £ C, we obtain by upper semicontinuity of 

<p{\\x n+m - x n \\ Wn+m ) ^xp{^ + T)4>{dc{x n )) +xr^e k . (3.16) 

Hence, appealing to (|3.13p and the summability of (efc)fceNj we deduce from (|3.16p that, as 
n ->■ +00, ^(||a; n+m - a?n||w ri+m ) -> and, hence, a||a; n+m - x n || 2 ^ ||x 

n+m X n 

Thus, (x ra ) ne N is a Cauchy sequence in H and there exists x G % such that x n — > x. By continuity 
of dc and (|3.13p . we obtain dcix) = and, since C is closed, x G C. □ 



4 The quadratic case 

In this section, we focus on the important case when <f> = \ • | 2 in Definition 13.11 Our first result 
states that variable metric quasi-Fejer monotonicity "spreads" to the convex hull of the target 
set. 

Proposition 4.1 Let a G ]0, +00 [, let (r/ n ) n£ N be a sequence in l\(N), let (W n ) nG N be a sequence 
in y a (7~L) such that 

p = sup ||W n || < +00 and (Vn G N) (1 + ^)W n fc= W n+1 . (4.1) 

neN 

Let C be a nonempty subset ofH and let (x n ) n ^fq be a sequence in T~L such that 
(3 (tmWn E ^(N)) (Vz G C) (3 (e n ) neN G £(N)) (Vn G N) 

lkn+1 - < 0- + Vn)\\x n ~ z\\\V n + £ n- (4.2) 

Then the following hold. 

(i) (x n )neN is | • \ 2 - quasi-Fejer monotone with respect to convC relative to (W n ) ne ^. 

(ii) For every y G convC, (\\x n - y\\w„)n& converges. 

Proof. Let us fix z G conv C. There exist finite sets {zj}j g / C C and C ]0, 1] such that 

Aj = 1 and z = AjZj. (4-3) 
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For every i G /, it follows from (|4.2p that there exists a sequence (ei, n )ngN £ ^+(N) such that 

(Vn G N) H^+i - 2i||w- n+1 ^ (1 + 77n)||x„. - ^j||vF n +£i, n - (4.4) 
Now set | 

(Vn G N) I 2 T^i J^i (4.5) 

= (1 + ~ «n+l + max{ei jn , . . . ,£ m ,„}. 

Then (max{ei jn , . . . , e mi „}) neN G £j_(N) and, by (071]), (Vn G N) (1 + rj n )a n ^ a n+ i. Hence, 
Lemma 12.21 asserts that (a n ) n g^ converges, which implies that (e n ) rag ^ 



(i) Using (03]), Lemma 2.13(h)], and we obtain 



(Vn G N) ||x n+ i - z||vk„ +1 = X] A *H x «+i ~ z i\\w n +i ~ Q ™+i 

iG/ 

< (1 + ?7n) ^ Ai||x n - 2j||w- n - «n+i + max{£i jn , . . . ,e m , n } 

iG/ 

= (1 + r] n )\\x n - z\\w n + (1 + f?n)«n - «n+i + max{ei jn , . . . ,e m , n } 
= {l + r] n )\\x n - z\\y /n + e n . (4.6) 



(ii) It follows from [5l Lemma 2.13(h)] that 



(Vn G N) \\x n - z\\w n = \\\x n ~ Zi\\w n ~ ( 4 -7) 



However, (a n ) nS N converges and, for every i G I, Proposition E^I)] asserts that (||x n — Zi||w n )neN 
converges. Hence, (||x n — ^||w n )neN converges. Now let y G conv C. Then there exists a sequence 



{Uk)keN i n convC such that y k — > y. It follows from (i) and Proposition I3.2;(i)| that, for every 
k G N, (\\x n — yk\\w n )n€N converges. Moreover, we have 

(Vfc G N)(Vn G N) - y//i\\y k - y\\ < -||y fc - y\\ Wn 

< [|a?n - y||w„ - Ikn - yjfe||w n 

< hk - y\\w n 

^VJibh-vl (4.8) 

Consequently, 

(Vfc G N) - v^lli/fe - ^ Mm Ikn - 2/||w„ - lim - yfc||w„ 

^ lim \\x n - w„ - bm \\x n ~ Vk\\w n 

^yfrWvk-vl (4.9) 

Taking the limit as k ->■ +oo yields lim n ^ +00 - y||vy„ = lim fc _^ +00 lim„_^ +00 ||x n - yfc||w„- □ 

Standard Fejer monotone sequences may fail to converge weakly and, even when they converge 
weakly, strong convergence may fail [X2^ 123]. However, if the target set C is closed and convex in 
(jl.ip . the projected sequence (Pcx n )neN converges strongly; see [2J Theorem 2.16(iv)] and [32~1 
Remark 1]. This property, which remains true in the quasi- Fejerian case |12|. Proposition 3.6(iv)], 
is extended below. 
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Proposition 4.2 Let a G ]0,+oo[, let (r/ n )reeN a sequence in let {W n ) n ^ be a uni- 

formly bounded sequence in T a (T-L), let C be a nonempty closed convex subset of %, and let 
(:c n )neN be a sequence in % such that 

e\{N)) (3 (r? n ) neN G ^(N))(Vz G C)(Vn € N) 



^n+l - «|lw- n+1 < (1 + ^n)||x n - z\\w n + £ n - (4-10) 



Then (P c n %n)neN converges strongly. 



Proof. Set (Vn G N) z n = P^ n x n . For every (m, n) G N 2 , since z n G C and z m+n = P^ n+m x. 
the well-known convex projection theorem [SJ Theorem 3.14] yields 

Zn+m \ %n+m Zn+m)\V n +m ^ 

which implies that 



n+mi 



(4.11) 



(^71 | -2-n+m)iy n +m — (^r( -^n+m | 3?n+m ^ii+m)lV n | m ||^n+m Zn+m\\w n +r, 



+m z n+m||w n+m - 



(4.12) 



Therefore, for every (m, n) G N 2 



+ \\Xi 



+m z n+m\\w n +r 



<r II _ II 2 - II _ II 2 

^ || Zn x n+m\\w n + m \\ x n+m z n+m\\w n + m ' 



(4.13) 



Now fix z G C, and set /i = sup ragN ||W n || and p = sup ngN \\x n — z\\y^ . Then p < +oo and, 
in view of Proposition I3.2^i)| p < +oo. It follows from (|4.10p that, for every n G N and every 



m G N \ {0}, since P^ n is nonexpansive with respect to || • \w n IS Proposition 4.8], we have 

n+m— 1 



\%n+m z n\\w n+m ^ 



Xn z n 1 1 \y„ 



Xn z n 1 1 W n 



Xn z n 1 1 W n 



%n ~ z n\\w„ + (^/fell^fc ~~ -^ti 1 1 VV^ fc + e k) 

k=n 

+ (2r/ fe (||x fc - z\\ 2 Wk + \\z n - z\\ 2 Wk ) +e k 

k=n 
n+m— I 

+ E (2v k (p+^\\P^x n -P^z\\ Wn )+e k 

k=n 
n+m— I 

+ E ( 2r lk( K P+ ^\\ x n ~ Z\\w n ) + £ k) 
k=n 
n+m— I 

x n -z n \\ 2 Vn + ^2 [2pr) k (l + -) + E k 



(4.14) 



k=n 



Combining (|4.13p and ()4.14p . we obtain that for every n G N and every m G N \ {0}, 



II 11^ <c II \\ z 

Ct\\Zn+m ^-n|| ^ \\Zn+m ZnuWn+m 



«S \\x n ~ Zn\\w n ~ \\x n +m ~ Z n +m||^ n+m + ^ hpVkU + ~) + £*:)■ (4.15) 



k>n 
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On the other hand, (|4.10p yields 

(Vn G N) \\x n+1 - z n+ i||^ n+1 < ||x n+ i - Znllwvn 

^ (1 + r} n )\\x n - Z n \\w n +£n, (4.16) 

which, by Lemma \2.2\ implies that (\\x n — z n \\w n )neN converges. Consequently, since (rjk)keN 
and (£k)keN are in ^(N), we derive from (|4. 15 j) that (z n )neN is a Cauchy sequence and hence 
that it converges strongly. □ 

In the case of classical Fejer monotone sequences, it has been known since [31] that strong 
convergence is achieved when the interior of the target set is nonempty (see also |12t Proposi- 
tion 3.10] for the case of quasi- Fejer monotonicity) . The following result extends this fact in the 
context of variable metric quasi-Fejer sequences. 

Proposition 4.3 Let a G ]0,+oo[ ; let (z^ n ) ne N G £+(N), and let (W n )„ e N be a sequence in 
y a (H) such that 

p = sup \\W n \\ < +oo and (Vn G N) (1 + u n )W n+1 fc= W n . (4.17) 

neN 

Furthermore, let C be a subset ofH such that int C^0, let z G C and p G ]0, +oo[ be such that 
B(z; p) C C, and let (x n ) ng N b e o sequence in % such that 

(3 (e n ) ne N G (r? n ) neN G ^(N))(Vs G B(z;p))(Vn G N) 

lkn+1 - x \\w n+1 ^ {l+Vn)\\x n ~ x\\w n +£n- (4.18) 

Then (x n ) n< =fq converges strongly. 

Proof. We derive from ()4.17f) and Proposition 13 . 2juj\ that 

£ = sup sup \\x n — x\\ 2 Vn ^ 2p{ sup \\x n — z\\ 2 + sup \\x — z\\ 2 I < +00. (4.19) 

xeB(z;p) neN V neN x£B(z;p) J 

It follows from P~T8|) and ([439]) that 

(Vn G N)(Vx G B(z;p)) \\x n+1 - x||^ n+1 ^ \\x n - x\\w n + £ n , where £ n = 07n + £n ■ (4.20) 
Now set 

(Vn G N) v n = PF n+1 (x n+1 -z)-PF n (x n -z), (4.21) 
and define a sequence (z n ) nS N in B(z; p) by 

I 0, if v n = 0; 

(Vn G N) z n = z — /ni n , where u n = < _ (4.22) 



Then 



Un/|K||, if V n / 0. 



'\\x n+1 - ZnW^ = \\x n+ i - z\$y + 2p(W n+1 (x n+1 - z) I u n ) 



(Vn G N) I + P 2 \\u n \\ 2 Wn+i ; (4-23) 

„ \\ x n ~ Zn\\w n = \\ x n ~ Z \\w n ^P(Wn{ x n ~ z ) \ U n ) + p 2 \\u n \\ ■ 
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On the other hand, (|4.20p yields (Vn G N) [|a? n +i ~~ z n\\w ^ W Xn ~ z n\\w + Therefore, it 
follows from ()4T23D . (|OI1> . and iOTf that 

(Vn G N) ||z n+1 - z||w- n+1 < ||x„ - z\\$y n - 2p\\v n \\ + p 2 (|K||^ n - ||n n ||^ n+i ) + £ n 

< ||x n - z||^ n - 2p\\v n \\ + p 2 pv n + £ n . (4.24) 

Since (p 2 pv n + £ n )neN G ^+(N), this implies that 

||w n +i - w n \\ = ||i> n || < +00, where (Vn G N) w n = W n {x n - z). (4.25) 

neN neN 

Hence, (w n )neN is a Cauchy sequence in H and, therefore, there exists w e H such that w n — > w. 
On the other hand, we deduce from (|4.17p and Lemma [2. 3;(ii)| that there exists W G '? a ('H) such 
that W n — > W. Now set x = z + W _1 m Then, since (W n ) ng N lies in T Q (^), it follows from 
Cauchy-Schwarz that 

a\\x n — x\\ ^ ||W n ^n — W n x\\ = \\w n — W n W~ x w || ^ \\w n — w\\ + \\w — W n W~ l w || -> 0, (4.26) 
which concludes the proof. □ 



5 Application to convex feasibility 

We illustrate our results through an application to the convex feasibility problem, i.e., the generic 
problem of finding a common point of a family of closed convex sets. As in [3], given a G ]0, +00 [ 
and W G 7 a (^H), we say that an operator T: H — )• % with fixed point set FixT belongs to 1(W) 
if 

(Vx G %)(Vy G FixT) (y - Tx \ x - Tx) w ^ 0. (5.1) 
If T G %(W), then [TJl Proposition 2.3(h)] yields 

(Vr G n)(Vy G FixT)(VA G [0,2]) ||(Id +A(T - Id))x - y\\ 2 w 

< ||x-y||^-A(2-A)||Tx-x||^. (5.2) 

The usefulness of the class %{W) stems from the fact that it contains many of the operators com- 
monly encountered in nonlinear analysis: firmly nonexpansive operators (in particular resolvents 
of maximally monotone operators and proximity operators of proper lower semicontinuous convex 
functions), subgradient projection operators, projection operators, averaged quasi-nonexpansive 
operators, and several combinations thereof [4"1 I5"l [T2]. 

Theorem 5.1 Let a G ]0, +oo[ ; let (Cj)j g / be a finite or countably infinite family of closed 
convex subsets of % such that C = f] ieI Ci 7^ 0, let (a n ) ng N be a sequence in % such that 
X^neN ll a «ll < +°°; ^ (Vn)n€N be a sequence in £+(N), and let (W n ) ne pj be a sequence in 7 a (T-L) 
such that 

p = sup [|W n || < +00 and (Vn G N) (1 + rj n )W n ^ W n+1 . (5.3) 

neN 

Let i : N — > I be such that 

(Vj G I)(3Mj G N \ {0})(Vn G N) j G {i(n), . . . , i(n + Mj - 1)}. (5.4) 
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For every i G I, let (Tj jn ) ne N be a sequence of operators such that 

(Vn G N) T i>n €Z(W n ) and FixT i<n = C». (5.5) 
Fix e £ ]0, 1[ and xo € /ei (A n ) n£ N 6e a sequence in [e, 2 — e], and set 

(Vn G N) x n+1 =x n + \ n (T i(n)>n x„ + a n - x n ) . (5.6) 
Suppose that, for every strictly increasing sequence (p n )neN in N, even/ x £ H, and every j G I, 



x p n ~^ x 



x g Cj. 



(5.7) 



[ (Vn G N) j = i(p n ) 
Then the following hold for some x G C. 



(i) x n ->> x. 

(ii) Suppose that int C 7^ and i/iai there exists (f n )ngN G ^+(N) such that (Vn G N) (1 + 
u n )W n+ i ^ W n . Then 

(iii) Suppose that lira dq(xn) = 0. Then 

(iv) Suppose that there exists an index j G / of demicompact regularity: for every strictly 
increasing sequence (p n )n<=N in N, 



sup neN ||x p J| < +00 

Tj,p„ X p n ~ X p n ~~ 

[ (Vn G N) j = i(p n ) 
Then x„ — > x. 



( x Pn)nGN has a strong sequential cluster point. (5.8) 



Proof. Fix z G C and set 



(Vn G N) y n = x n + A n (T i(n ) in x n - x n ) . 



(5.9) 



Appealing to (|5.2p and the fact that, by virtue of (|5.4p . z G Hie/ C« = PlneN ^ x -^i(n),«' we 
obtain, 



(Vn G N) \\y n — z\\yy n ^ \\ x n — z \\\V n ~ An(2 — A n )||Tj( n ) jn X n — Xnllw^ 

<^ II 11^ r-^ I I r T' I I ^ 

5* \\ x n z \\Wn ll p M(ri),»i*''W -^n 1 1 VK„ • 



Moreover, it follows from (|5.3p that 



(Vn G N) \\y n - z\\^ < (1 + - z| 



(5.10) 
(5.11) 



Thus, 



(Vn G N) ||y„ - z\\w n+1 < (1 + ?7n)|kra - z||vK„ ~ £ 2 (! + %) II ^(^.n^n - ^n||w n 

^ (1 + Vn)\\x n — z \\\V n ~ £2 \\Ti( n ),n x n ~ x n\\w n (5.12) 
^(1+Vn)\\x n - z\\ 2 Wn . (5.13) 
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Using (HHD, (prgjl . and (I5TT3]) . we get 

(Vn G N) \\x n+ i - z\\ Wn+1 < ||?/n - z||w„+i + A n ||a n || Wn+ i 



< \A + %ll^n - z||w„ + 

< (1 + ?7„)||x n - jb||wt b + 2 V //I||a n ||, (5.14) 

which shows that 

(x n ) n m satisfies (|3.2|) - and hence (|3.ip - with cj) = I • I- (5.15) 
It follows from ()5.15p and Proposition I3.ffilj| that (\\x n — z\\w n )neN converges, say 

\\x n ~ z\\ Wn -)■ £ € M. (5.16) 
We therefore derive from (|5.14p that ||y n — .z||w n+1 —> £ and then from (|5.12p that 

a£2 \\Ti( n ),n x n ~ X n \\ 2 ^ E 2 \\T^ n ^ n X n — X n \\ 2 y n ^ (1 + ?7n)||x n — z\\w n ~ WVn ~ z \\\y n+1 — > 0. (5.17) 



(i) It follows from Qgjty and (15TTT)) that 



ll^n+l X n \\ — X n \yi\f n \ n X n -\- d n 

s% 2(||T i(n ) in x n - x n \\ + \\a n \\) 

< 2 [\\ T i(n),n x n ~ X n \\w n /V^+ \\ a n\\) 

-> 0. (5.18) 

Now, fix j G / and let x be a weak sequential cluster point of (x„) ng N- According to (|5.4p . there 
exist strictly increasing sequences (fc n )neN and (p n )ngN in N such that Xk„ — x and 

(Vn G N) < n rt 3 n+i^n+i, 

[J = i(Pn)- 

Therefore, we deduce from (|5.18p that 

k n +Mj-2 

\\ X Pn ~ X k n \\ < + 1 ~ X 'H 

^ (M,- — 1) max \\xi+i — xA\ 

kn^Kkn+Mj-2 

-> 0, (5.20) 



which implies that x Pn — v x. We also derive from (|5.17p and (|5.19p that Tj tPn x 
Ti( Pn ). Pn Xp„ — x Pn — >• 0. Altogether, it follows from (|5.7p that x £ Cj. Since j was arbitrarily 
chosen in /, we obtain x G C and, in view of Lemma I2.3;(i)| and Theorem 13.31 we conclude that 

Xri. ^ X. 



Suppose that z G int C and fix p G ]0,+oo[ such that B(z;p) C C. Set r] = sup ngN 77 n , 



C = sup x . gB(2;p) sup nGN ||x n - x\\ Wn , and 



(Vn G N) e n = 4(C V / «(l + «)l|an|| +^||a„|| 2 ). (5.21) 
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Then rj < +00 and, as in (|4.19p . C < +00. Therefore (e n )neN G £4- (N). Furthermore, we derive 
from ()5.6p . ()5.9|) . and (I5.13P that, for every x G -B(z; p) and every n G N, 



\x n +i — x\\w„+i ^ WVn ~ x llw„+i + 2A n ||y n — x||w„+i || a n||wWi + \il| a n||w„ + l 

^ (1 + r] n )\\x n - + 4yV(l + ry n )||x n - x||w n ||a n || + 4/i||a n || 2 
< (1 + %)||a?n - ^llw-„ + £ n- 



(5.22) 



Altogether, the assertion follows from (i) and Proposition 14.3 



(hi) This follows from (|5.15p . Proposition 13.41 and (f 



(iv) Let j £ I be an index of demicompact regularity and let (p n )nen be a strictly increasing 

j = i(p n ). Then (x Pn ) ne N is bounded, while (|5.17p asserts that 
0. In turn, (|5.8|) and (i) imply that x Pn — > x £ C. Therefore lim dc(x„) ^ 



sequence such that (Vn £ 



L j,Pn X Pn 



'Vn 



X 



and (hi) yields the result. □ 



Condition (|5.4p hrst appeared in [9], Definition 5]. Property (|5.7p was introduced in [2j Def- 
inition 3.7] and property (|5.8p in [12, Definition 6.5]. Examples of sequences of operators that 
satisfy (|5.7p can be found in El U2] - Here is a simple application of Theorem l5.1l to a variable 
metric periodic projection method. 

Corollary 5.2 Let a £ ]0,+oo[, let m be a strictly positive integer, let I = {1, . . . ,m} , let 
(Cj)j e / be family of closed convex subsets of H such that C = Hie/C^ 7^ 0, let (a n ) nS M be a 
sequence in % such that ^ n eN H an ll < +°°; ^ (Vn)neN be a sequence in £\(N), and let (W n ) n£ fq 
be a sequence in such that sup„ eN ||W n || < +00 and (Vn £ N) (1 + rj n )W n )p W n+ \. Fix 

e £ ]0, 1[ and xq £ %, let {\ n )n&n be a sequence in [e, 2 — e], and set 



(Vn £ N) x n+ i = x n + A n ( PJf™ x n + a n 



(5.23) 



where rem(-, m) is the remainder function of the division by m. Then the following hold for some 
x £ C. 



(i) x n x. 

(ii) Suppose that int C 7^ and i/iai i/iere exists (f n )ngN G ^+(N) smc/i £/ia£ (Vn G N) (1 + 
^ n )W n+ i )>= W n . Then x n x. 

(hi) Suppose that there exists j £ I such that Cj is boundedly compact, i.e., its intersection with 
every closed ball of rl is compact. Then x n —> x. 



Proof. The function i: N — > I: n 1— > l + rem(n, m) satisfies ()5.4p with (Vj G I) Mj = m. Now, set 
(Vi G I)(Vn G N) T i>n = P™ n . Then (Vi G J)(Vn G N) r ijtl G T(H / n ) and FixT ijn = C { . Hence, 
(|5.23|) is a special case of (|5.6p . 



(i) - (ii) Fix j £ I and let (x Pn ) ne N be a weakly convergent subsequence of (x n ) n£ N 5 say x Vn 

w v . 



x, such that Tj tPn x Pn - x Pn — > and (Vn G N) j = i(j>„). Then B P c Pn x Pn = Tj jPn x Pn — ^ x 
and, since Cj is weakly closed j5j Theorem 3.32], we have x £ Cj. This shows that (|5.7p holds. 
Altogether, the claims follow from Theorem 15. l|(i) (ii) 
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(iii) Let {p n )neN be a strictly increasing sequence in N such that P^ Vn x 



Tj,Pn X Pn 



and (Vn G N) j = i(p n )- Then 



\PCj X p n X Pn\\ ^ of" 00 ?™ 



v Pn I 



0. 



(5.24) 



On the other hand, since (x Pn ) ng N is bounded and Pcj is nonexpansive, {Pcj x p n )neN is a bounded 
sequence in the boundedly compact set Cj. Hence, (PCj x p„)neN admits a strong sequential cluster 

0. Thus, j € I is an index of demicompact 



x 



point and so does (x Pn ) ne ® since Pc 3 x Pn 
regularity and the claim therefore follows from Theorem [5J |lv) □ 



Pn 



Remark 5.3 In the special case when, for every n G N, W n = Id and rj n = 0, Corollary I5.2;(i) 
was established in [8] (with (Vn 6 N) A n = 1), and Corollary HTffii)] in [22] , 



Next is an application of Corollary 15.21 to the problem of solving linear inequalities. In 
Euclidean spaces, the use of periodic projection methods to solve this problem goes back to 

m 



Example 5.4 Let a G ]0, +oo[, let m be a strictly positive integer, let I = {1, . . . , m}, let («;)«£/ 
be real numbers, and suppose that (nj)j g j are nonzero vectors in % such that 



C = {x G H | (Vi G /) (x | u.;) ^ rcj ^ 0. 



(5.25) 



Let (ry n )neN be a sequence in ^_(N), and let (W n ) n ^n be a sequence in IPq,^) such that 
sup ngN ||W n || < +oo and (Vn G N) (1 + r) n )W n > W n+1 . Fix e G ]0, 1[ and x G let 
(\ n )neN be a sequence in [e, 2 — e], and set 

i(n) = 1 + rem(n, m) 
if (x n | u i(n) ) 77 i(n ) 

(Vn G N) if ( )) > ^i(n) (5.26) 

Vi(n) ~ ( x n | W i(n) ) 



x n + 



(«i(n) I 1 «i(n)) 

Xn+i — x n + A n (y ra x n ). 



W n V(n) 



Then there exists x G C such that x r 



Proo/. Set (Vi G /) Cj = {x G U \ {x \ m) < r/j}. Then it follows from Example 28.16(iii)] 
that (|5.26p can be rewritten as 



(Vn G N) x n+1 =x n + \ n (p^ +r 



l+rem(n,m) 



(5.27) 



The claim is therefore a consequence of Corollary I5.2;(i)| □ 



We now turn our attention to the problem of finding a zero of a maximally monotone operator 
A: Ti — > 2^ (see [5] for background) via a variable metric proximal point algorithm. Let a G 
]0,+oo[, let 7 G ]0,+oo[, let W G CPa('H), and let A: % — > 2 W be maximally monotone with 
graph graA It follows from [31 Corollary 3.14(h)] (applied with /: x i— > (Wx \ x)/2) that 



J™ A :U^U: x^ (W + jA)-\Wx) 



(5.28) 
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is well-defined, and that 



J™ A G X(W) and Fix = {z G ft | G A?}. 



(5.29) 



We write = J 7 a- 



Corollary 5.5 Lei q G ]0,+oo[, let A: % —> 2^ be a maximally monotone operator such that 
C = {z G % | G Az} ytz ; let (a n ) ng N be a sequence in % such that X^neN H a ™ll < 
Zei (r/ n ) ng N be a sequence in and let {W n ) n gs be a sequence in y^TL) such that n = 

sup ngN ||W n || < +00 and (Vn G N) (1 + r/ n )W n W n+ \. Fix e G ]0, 1[ and x G ft, Zei (A n ) ng N 
6e a sequence in [e, 2 — e], Zet (7 n )neN &e a sequence in [e, +oo[, and set 



(Vn G N) x n+ i = 
Then the following hold for some x G C. 



(5.30) 



(i) x„ x. 

(ii) Suppose that int C / and i/iai there exists (^n)ngN G ^(N) ««c/i tfiai (Vn G N) (1 + 
^ n )W n+ i )>= W n . Then x n ? x. 

(iii) Suppose that A is pointwise uniformly monotone on C, i.e., for every x G C there exists 
an increasing function (ft: [0, +oo[ — >• [0, +oo] vanishing only at such that 



(Vn G Ax)(\/{y, v) G graA) (x — y \ u — v) ^ 4>{\\x — y\\). 



(5.31) 



Then x n 



x. 



Proof. In view of (15T291 . (fOOjl is a special case of ([521) with I = {1} and (Vn G N) Ti jn = J™ n A . 
Hence, using Theorem I5.l|(ij (ii) to show (i)-(ii) it suffices to prove that (|5.7p holds. To this 



end, let (x Pn ) ng N be a weakly convergent subsequence of (x n ) ng pj, say x Pn — 1 x, such that 



0. To show that G Ax, let us set 



(Vn G N) y n = J n A x n and i> n = —W n {x r 



In 



Then (|5.28|) yields (Vn G N) u n G Ay n - On the other hand, since y Pn 



0, we have 



\W Pn (x Pn -y Pn 



^11* 



Vn 



Up n I 



0. 



(5.32) 



(5.33) 



7 P n e 

Thus, y Pn — 1 x and j4y Pn 9 i> Pn — » 0. Since graA is sequentially closed in % weak x % stron s [5j 



Proposition 20.33(h)], we conclude that G Ax. Let us now show (iii) We have G Ax and 
(Vn G N) v Pn G Ay Pn . Hence, it follows from (|5,3ip that there exists an increasing function 
4>: [0, +oo[ — > [0, +oo] vanishing only at such that 



(Vn G N) (y Pn - x | v Pn ) ^ <p{\\y Pn - x\\). 
Since v Pn — > 0, we get 4>(\\y Pn —x\\) — > and, in turn, \\y Pn — x\\ — > 0. It follows that \\x Pn 



(5.34) 



and hence that lim dn(x„) = 0. In view of Theorem [571 liii) , we conclude that x n — > x. □ 
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Remark 5.6 Corollary \5l FIT reduces to the classical result of [34|, Theorem 1] when (Vn G 



W n = Id, rj n = 0, and A n = 1. In this context, Corollary I5.^(ii)| appears in [281 Section 6]. In a 
finite-dimensional setting, an alternative variable metric proximal point algorithm is proposed in 
[29], which also uses the above conditions on (W n ) n ^ but alternative error terms and relaxation 
parameters. 



6 Application to inverse problems 



In this section, we consider an application to a structured variational inverse problem. Hence- 
forth, To(Ti) denotes the class of proper lower semicontinuous convex functions from H to 
]-oo, +oo]. 

Problem 6.1 Let / G Tq(T-L) and let I be a nonempty finite index set. For every i G I, let 
(Gi, || • ||i) be a real Hilbert space, let Lj : % — > Qi be a nonzero bounded linear operator, let 
Ti G Qi, and let ^i G ]0, +oo[. The problem is to 

minimize f(x) H — /Ji\\LiX — Ti\\f. (6-1) 
iei 



This formulation covers many inverse problems (see |17t Section 5] and the references therein) 
and it can be interpreted as follows: an ideal object x G T~L is to be recovered from noisy linear 
measurements rj = LiX + Wi G Qi, where Wi represents noise (i G L), and the function / penalizes 
the violation of prior information on x. Thus, (|6.ip attempts to strike a balance between the 
observation model, represented by the data fitting term x t-t (1/2) Yliei faW^iX — J"j||f, and a 
priori knowledge, represented by /. To solve this problem within our framework, we require the 
following facts. 

Let a G ]0, +oo[, let W G ^aiTi), and let ip G Toffl). The proximity operator of ip relative to 
the metric induced by W is 

proxjf : H ->■ %: x (->■ argminf <p(y) + -\\x - y\\w] ■ ( 6 - 2 ) 

yen V 2 J 

Now, let dtp be the subdifferential of tp Chapter 16]. Then, in connection with (|5.28p . dip is 
maximally monotone and we have [161 Section 3.3] 

(V 7 G ] , +oo[) prox^ = J\ = {W + jdip)- 1 o W. (6.3) 
We write proxj^ = prox,^. 

Lemma 6.2 Let A: % — > 2^ be maximally monotone, let U be a nonzero operator in !Po(%), let 
7 G ]0,1/||C/||[, letueH, setW = ld-jU, and set B = A + U + {u}. Then 

(Vx G ft) J^x = J lA {Wx - ju) . (6.4) 
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Proof. Since U G 7q(%), U is maximally monotone [5J Example 20.29]. In turn, it follows from [5l 
Corollary 24.4(i)] that B is maximally monotone. Moreover, W G T a (T-L), where a = 1 — 7||J7||. 
Now, let x and p be in T~L. Then it follows from (|5,28p that 

p = J^ B x 44> Wx G Wp + <^ VFx — ju £ p + jAp <^ p = J 7 a (Wx — ju) , (6.5) 

which completes the proof. □ 

Proposition 6.3 Let e G ]0, 1/(1 + X^e/ /^ll-^ll 2 ) \> ^ ( a n)ngN be a sequence in % such that 
X^nGN \\ a n\\ < +oo, let (n„) ng N be a sequence in ^+(N), and let ( r y n )n£N be a sequence in R such 
that 

(Vn G N) e ^ 7n < — and (1 + 77^)7^ - 7„+i ^ — — -. (6.6) 

/ , Mill Li \\ / 4 Mill-^ill 

Furthermore, let C be the set of solutions to Problem \6. 11 let xq G TL, let (X n )neN be a sequence 
in [e, 2 — e], and set 



(Vn G N) x n+ i = x n + A n ^ prox 7n/ ^x n + 7n ^ Mi-^I ( r i ~ L i x n) ^ + a n - x^j . 

Then the following hold for some x G C. 
(i) Suppose that 



(6.7) 



lim f[x) + - y^UiWUx - n\\f = +00. (6i 



H*ll^+oo 2 , e/ 



Then x n — x. 

(ii) Suppose that there exists j G I suc/i i/ioi is bounded below, say, 

(3/3 G ]0,+oo[)(Vx G H) HLjxIlj ^ (6.9) 
Xnen C = {x} and x n — >• x. 

Proo/. Set f7 = ^ie/ Mi-^I-^i an d n = — ]^ ig/ A*i-^i r i- Then 

^ Mill^ill 2 , (6-10) 

and the assumptions imply that ^ U G J'o(^) an d that (Vn G N) e ^ 7„ < (1 — e)/||C/||. Now 
set 

g: TL ^ ]— 00, +00] : x h-> /(x) + ~^(Ux \ x) + {x \ u) (6-11) 

and 

(Vn G N) W n = Id -7„*7. (6.12) 

Then (|6.ip is equivalent to minimizing g. Furthermore, it follows from (|6.6p that (Wn)neN lies 
in "P e (TL) and that sup ngN ||Wn|| ^ 2 — e. In addition, we have 

(Vn G N) 7/ n > ((l + 7M)7n-7n+i)||tf||. (6.13) 
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Indeed if, for some n G N, (l + n„)7 n ^ 7n+i then i] n ^ ^ ((l + %)7n — 7n+i)||^1|i otherwise we 
deduce from ([621) and dfUOJ) that j] n ^ ((l+?7n)7n-7n+l) ]T\ gJ MiH-M 2 > ((l+r7n)7n-7n+i)||#1l- 
Thus, since f7 G lPo(%); we have ||£/|| = sup|| x ||^ 1 (L r x | x) and therefore 

([§33} ^ (Vn G N)(Vx G n^xf ^ ((1 + Vn ) ln - 7 n+ i){Ux | x) 

(VnG N)(VxG^) (l + r ? „)(||x|| 2 -7 n (;7x|x)) ^ ||x|| 2 -7 n+ i(^x|x) 

(Vn G N) (l+r? n )W n ^ W n+ i. (6.14) 

Now set A = df and B = A + U + {u}. Then we derive from [5j Corollary 16.38(iii)] that B = dg. 
Hence, using (|6.3p . (|6.12p . and Lemma [6721 (|6. T[) can be rewritten as 

(Vn G N) x n+1 = x n + X n ( prox 7n/ (x n - j n (Ux n + u)) +a n -x n 
= x n + A n ( J~ jn A{W n x n - j n u) +a n - x r 

= X n + Xn^J^JgXn + a n - Xn\ . (6.15) 

On the other hand, it follows from Fermat's rule [5j Theorem 16.2] that 

{z G U | G Bz] = Argmin # = C. (6.16) 



(i) : Since / G T (H) and J7 G y (^), it follows from Proposition 11.14(i)] that Problem IfU 



admits at least one solution. Altogether, the result follows from Corollary !5.E|(i)[ 



(ii)| It follows from <^M) that L*Lj G J>(%). Therefore, C/ G 7 H ^(n) and, since / G T (n), 
we derive from (|6.1ip that g G To('H) is strongly convex. Hence, Corollary 11.16] asserts that 
(|6.ip possesses a unique solution, while Example 22.3(iv)] asserts that B is strongly - hence 



uniformly - monotone. Altogether, the claim follows from Corollary [22 [hi) □ 



Remark 6.4 In Problem 16.11 suppose that / = {1}, [i\ = 1, L\ = L, and r\ = r, and that 
lim|| a; ||^ +00 f(x) + \\Lx — r\\f/2 = +00. Then fj6.7f) reduces to the proximal Landweber method 

(Vn G N) x n+1 = x n + A n ^prox 7n/ (x n + j n L*(r - Lx n )) + a n - x n ^j , (6.17) 

and we derive from Proposition I6.!j|(i)| that (x n ) n£ N converges weakly to a minimizer of x 1— > 
f{x) + \\Lx-r\\\/2 if 



(Vn G N) 



2 



[e^ ln ^{l-e)/\\L\ 

{l + r] n )ln^ln+l + r]n/\\L\\ 2 (6.18) 

e < A n < 2 - e. 



This result complements [17} Theorem 5.5(i)], which establishes weak convergence under alter- 
native conditions on the parameters (7 n )neN and (\ n )n&h namely 

(Vn € N) (2 -«)/|lf 

On ^ 1. 

In particular, suppose that H is separable, let iek)k&\ be an orthonormal basis of H, and set 
/: x i-)- 2^ fceN </>A,.((x I e fc))> where (V/c G N) r (K) 3 4>k > 4>k(fy = 0. Moreover, for every n G N, 
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let (a n ,fc)fceN be a sequence in £ 2 (N) and suppose that X^neN Vz^feeN l a n,fe| 2 < +00. Now set 
(Vn G N) a n = £ fc eN 

a n,k e k- Then, arguing as in [17, Section 5.4], ()6.17p becomes 
(Vn G N) x n+1 = Xn + X n i ^2 ( a n,k + prox 7n<fe (x n + 7„L*(r - Lx n ) \ e k ))e k - x n J , (6.20) 

and we obtain convergence under the new condition (|6.18p (see also |15| for potential signal and 
image processing applications of this result). 
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